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.1  III 


1 .  Introduction 
1 . 1  Background 

The  DOD  Computer-aided  Acquisition  and  Logistic  Support  (CALS) 
Test  Network  (CTN)  is  conducting  tests  of  the  military  standard 
for  the  Automated  Interchange  of  Technical  Information,  MIL-STD- 
1840A,  and  its  companion  suite  of  military  specifications.  The 
CTN  is  a  DOD-sponsored  confederation  of  voluntary  participants 
from  industry  and  government  managed  by  the  Air  Force  Logistics 
Command . 

The  primary  objective  of  the  CTN  is  to  evaluate  the  effectiveness 
of  the  CALS  standards  (Standards)  for  technical  data  interchange 
and  to  demonstrate  the  technical  capabilities  and  operational 
suitability  of  those  Standards.  Two  general  categories  of  tests 
are  performed  to  evaluate  the  Standards,  formal  and  informal. 
Formal  tests  are  large,  comprehensive  tests  that  follow  a  written 
test  plan,  require  specific  authorization  from  DOD,  and  may  take 
months  to  prepare,  execute,  and  report. 

Informal  tests  are  quick  and  short,  taking  only  a  few  hours  to 
set  up  and  execute.  They  are  used  by  the  CTN  technical  staff  to 
broaden  the  testing  base  by  including  representative  samples  of 
the  many  systems  and  applications  used  by  CTN  participants.  They 
also  allow  the  CTN  staff  to  gain  feedback  from  many  industry  and 
government  interpretations  of  the  Standards,  to  increase  the  base 
of  participation  in  the  CALS  initiative,  and  to  respond,  in  a 
timely  manner,  to  the  many  requests  for  help  that  come  from 
participants.  Participants  take  part  voluntarily  and  are  bene¬ 
fited  by  receiving  an  evaluation  of  their  latest  implementation 
(interpretation)  of  the  Standards,  interacting  with  the  CTN 
technical  staff,  gaining  experience  in  use  of  the  Standards,  and 
developing  increased  confidence  in  them.  The  results  of  informal 
tests  are  reported  in  Quick  Short  Test  Reports  (QSTRs)  that 
briefly  summarize  the  standard (s)  tested,  the  hardware  and  soft¬ 
ware  used,  the  nature  of  the  test,  and  the  results. 


1 . 2  Purpose 

The  purpose  of  the  informal  test  reported  in  this  QSTR  is  to  analyze  six 
software  tools:  TAPEVAL,  MAKETAPE,  STRIPIGES,  STRIPRASTER,  STRIPTEXT,  and 
VALIDG4.  The  test  is  to  verify  that  these  tools  meet  CALS  requirements  by 
running  them  with  CTN  data. 
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2. 


Test  Parameters 


Test 

Date: 

Evaluaton 


Software 

Tools  Originaton 


Software 

Tools  Description: 
TAPEVAL 
MAKETAPE  - 

STRIPIGES 
STRIPRASTER  - 
STRIPTEXT  - 
VA1JDG4 


Test  Data: 


Test  Platform: 

Hardware: 

Software: 

Evaluation  Criteria: 


2  January  through  30  April  1990 

Army  CALS  TEST  BED 
PM  CALS 
Mycr  Center 

Fort  Monmouth,  NJ  07723 


CALS  Test  Network 

Lawrence  Livermore  National  Laboratory 
P.O.  Box  808,  L.542 
Livermore,  CA  94550 


Validates  tape  compliance  with  MIL-STD-1840A 

Creates  declaration  files  and  header  records,  appends  associated  data  files  and  writes 
them  to  magnetic  tape  in  MIL-STD-1840A  format. 

Removes  IGES  file  header 

Removes  raster  file  header 

Removes  text  file  header 

Validates  CCITT  Group  4  raster  file  format 


The  CTN  test  data  used  to  test  each  tool  arc  identified  by  tool  in;  Section  2  of  this 
report. 


Digital  Equipment  Corporation  VAX  11/780  computer  system 
Cipher  M990  magnetic  tape  drive 
VMS  version  53  operating  system 

a.  Ability  to  perform  its  intended  function 

b.  Ease  of  installation 

c.  Operating  system  issues 
cL  Ease  of  use 
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3.  Analysis  of  Software  Tools 


3.1  Analysis  ofTAPEVAL 

3.IJ.  Version 

The  Tool  Set  Version  exercised  was  received  on  9-track  magnetic  tape  from  the  CTN  and  was  labeled  as  follows. 
Tools  Revision  .9  ,  label  =  toolOl 

The  comments  in  the  ptapeval.com  source  code  contained  the  following  version  information: 

-  TAPEVAL  Version  0.8  -  Beta  Version  -  26  July  1989’ 

-  Modified  12/23/86  by  Mark  Steele  requires  Operator  Privileges 

-  Modified  11/88 

-  9/4/89- Joe  Greco,  Jeff  Howells 

The  documentation  supplied  was  "Preliminary  User’s  Manual  for  TAPEVAL  Tool,  dated  16  May  1989. 

312  Ease  of  Installation 

In  our  first  attempts  to  run  ptapeval.com,  we  ran  into  some  problems  concerning  setting  up  the  program  to 
execute  on  our  VAX.  We  first  tried  using  the  command  Ime  "$run  ©ptapeval"  which  is  similar  to  what  was 
suggested  on  page  4  of  the  user’s  manual.  This  resulted  in  a  VMS  error  message  "too  many  parameters."  We 
then  entered  the  command  in  the  correct  format  as  noted  on  page  6  (i.e.  "@ptapeval")  and  received  another 
error  message  "invalid  device  name."  We  looked  at  the  code  for  the  ptapeva'.com  file  Md  replaced  the 
"dSu:[aiti.software.pgms]"  portion  of  the  path  name  m  the  calls  to  run  tpimport  and  doedeeval  with  the  path  naine 
being  used  on  our  VAX.  This  still  did  not  work  until  we  set  our  process  pririleges  to  included  phy-10  and  log-io 
(as  directed  by  comments  in  the  ptapev2J.e0m  file  but  not  mentioned  in  the  user  s  manual). 

As  noted  above,  there  were  a  few  problems  encountered  in  the  installation  ofTAPEVAL.  These  problems  were 
solved  fairly  quickly  by  personnel  with  a  limited  knowledge  of  VMS.  It  is  recommended  that  the  user’s  manual 
be  revised  to  reflect  the  comments  in  the  source  code  that  address  the  initial  set  up  of  user  account  pnvJeges. 

313  Operating  System  Issues. 

This  tool  was  designed  to  run  under  a  VMS  operating  system  version  51  or  later.  We  ran  it  under  version  53 
and  encountered  no  problems  pertaining  to  the  operating  system. 

3JL.4  Ease  of  Use 

The  use  of  this  routine  was  straight-forward. 

3.13  Execution 

The  TAPEVAL  Tool  was  first  tested  using  the  MIL-STD-1840A  Tape  from  the  CTN  containing  MIL-D-!^ 
Class  n  Reference  Drawinp  -  Revision  C.  Further  testing  was  conducted  using  the  CTN  Raster  Test  Smte  MIL- 
STD-1840A  tape  and  the  Teclmical  Publications  for  CALS  EXPO’89  MIL-STD-1840A  tape.  The  findings  are 
as  follows: 
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a ,  In  the  val-tapc  log  for  both  the  IGES  and  Raster  tapes,  there  was  an  error  message  which  stated  that 
sredodd  in  the  data  file  did  not  match  sredodd  in  the  dedaradon  file.  This  data  appears  to  have  been 
entered  that  way  intendonally  as  indicated  by  the  text  in  the  sredodd  field. 

b .  When  processing  the  Tech  Pubs  tape  an  error  message  in  the  val-tape  log  file  indicated  that  the  date 
in  record  9  of  the  dedaradon  file  was  invalid.  The  CTN  has  indicated  that  this  is  a  known  bug  relating 
to  the  software  identifying  dates  with  years  greater  than  1989  as  being  errors. 

C  •  When  running  the  routine,  we  had  to  specify  to  ptapeval  to  put  the  data  files  m  the  same  directory 
in  which  the  tool  was  located.  Otherwise,  ptapeval  reai  the  tape  and  brings  the  files  into  the  VAX  but 
the  subroutine  doedeeval  cannot  locate  them. 

3.1.6  Summary 

The  TAPEVAL  routine  worked  properly  when  tested  with  the  CTN  data.  The  only  error  discovered  was  in  the 
flagging  of  the  date  in  record  9  of  the  dedaradon  file  for  the  Tech  Pubs  data  as  being  in  error.  Otherwise,  the 
routine  performed  as  intended  and  was  easy  to  use. 


3a  Analysis  of  MAKETAPE 
32.1  Version 

The  comments  in  the  maketape.c  source  contained  the  following  version  infonnadon: 


Program  name: 
Source  code: 
Date  written: 
Author: 

Date: 

Version: 


maketape 
maketape.c 
12  OCT  1988 
SYSCON  Corporadon 
attn:  Joe  Greco 
31  July  1989 
Beta  version  0.9 


The  documentadon  supplied  was  the  Trclimmary  User’s  Guide  for  MAKETAPE,"  dated  3  April  1989. 

322  Ease  of  Installadon 

Installadon  was  accomplished  without  problems  by  following  the  procedures  in  the  user’s  guide. 

323  Operating  System  Issues 

This  tool  was  designed  to  run  under  a  VMS  operating  system  version  5.1  or  later.  We  ran  it  under  version  53 
and  encountered  no  significant  problems  pertaining  to  the  operating  system. 

3,2.4  Ease  of  Use 

The  key  to  using  this  tool  is  to  construct  the  MAKETAPE  directory  in  accordance  with  the  user's  guide.  Once 
the  software  is  mstalled,  the  menu-driven  program  is  easy  to  use. 
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3  2S  Execution 


Wc  attempted  to  make  a  tape  from  the  Class  II  IGES  drawing  files  received  from  CTN.  These  files  were 
imported  from  9-track  magnetic  using  the  TAPEVAL  tool  and  were  stored  on  the  VAX.  Next,  the  file  headers 
were  removed  from  the  data  files.  The  MAKETAPE  tool  was  invoked  to  reconstruct  these  files  into  MEL-STD- 
184QA  format.  The  tool  appeared  to  work.  However,  the  tape  it  created  only  contained  the  declaration  file. 
An  analysis  of  the  tool  revealed  that  the  data  and  data  header  files  were  not  being  appended  and  stored  in  a 
.temp  file  as  described  in  the  documentation.  This  file  is  supposed  to  have  been  created  when  the  append  data 
file  header  routine  was  executed. 

3JZ.6  Summary 

This  tool  appears  to  have  a  bug  that  prevents  it  from  creating  the  file  consisting  of  the  header  data  appended 
to  the  document  data. 


33  Analysis  of  STRIPIGES 

3J.1  Version 

There  was  no  version  number  sissociated  with  this  tool  in  its  source  code  comments.  This  tool  was  received  on 
the  same  tape  as  TAPEVAL  and  MAKETAPE  (Tools  Revision  .9  ,  label  =*  toolOl). 

33.2  Ease  of  Installation 

STRIPIGES  was  imported  to  the  VAX  without  incident. 

333  Operating  System  Issues 

This  tool  was  designed  to  run  under  a  VMS  operating  system  version  5.1  or  later.  We  ran  it  under  version  53 
and  encountered  no  problems  pertaining  to  the  operating  system. 

33.4  Ease  of  Use 

This  tool  is  invoked  with  the  one  word  command  STRIPIGES  and  proceeds  to  separate  the  1840  IGES  files 
into  its  header  and  data  components. 

333  Execution 

This  tool  was  tested  using  the  IGES  Class  I  and  Class  II  Reference  Drawmgs  from  the  CTN,  When  tool  was 
run,  it  seemed  to  execute  properly.  Upon  examining  the  resulting  header  and  data  files,  it  was  found  that  only 
five  of  the  seven  header  records  were  removed.  An  analysis  of  the  source  revealed  that  a  loop  variable  had  the 
initial  value  of  five  when  it  should  have  had  seven. 

33.6  Summary 

This  tool  appears  to  have  a  minor  bug  that  prevents  total  separation  of  the  header  record  from  the  IGES  files. 
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3.4  Analysis  of  STRIPRASIER 
3.4.1  Version 

There  was  no  version  number  associated  with  this  tool  in  its  source  code  comments.  This  tool  was  received  on 
the  same  Upe  as  TAPEVAL  and  MAKETAPE  (Tools  Revision  .9  ,  label  »  toolOl). 

3^1.2  Ease  of  Installation 

STRIPRASTER  was  imported  to  the  VAX  without  incident. 

3.43  Operating  System  Issues 

This  tool  was  designed  to  run  under  a  VMS  operating  system  (version  5.1  or  later).  We  ran  it  under  version 
53  and  encountered  no  problems  pertaining  to  the  operating  system. 

3.4.4  Ease  of  Use 

This  tool  is  invoked  with  the  one  word  command  STRIPRASTER  and  proceed  s  to  separate  the  1840  RASTER 
files  into  its  header  and  data  components. 

3.45  Execution 

This  tool  was  tested  using  the  RASTER  Type  I  and  Type  n  Reference  Drawings  from  the  CTN.  When  tool  was 
run,  it  executed  properly. 

3.4,6  Summary 

This  tool  performs  its  intended  function. 


35  Analysis  of  STRIPTEXT 
35.1  Version 

There  was  no  version  number  associated  with  this  tool  in  its  source  code  comments.  This  tool  was  received  on 
the  same  tape  as  TAPEVAL  and  MAKETAPE  (Tools  Revision  .9  ,  label  =»  tooIOl). 

352  Ease  of  Installation 

STRIPTEXT  was  imported  to  the  VAX  without  inddenL 
355  Operating  System  Issues 

This  tool  was  designed  to  run  under  a  VMS  operating  system  version  5.1  or  later.  We  ran  it  under  version  53 
and  encountered  no  problems  pertaining  to  the  operating  system. 

35.4  Ease  of  Use 

This  tool  is  invoked  with  the  one  word  command  STRIPTEXT  and  proceeds  to  separate  the  1840  SGML  files 
into  its  header  and  data  components. 


3J5J  Execution 


This  tool  was  tested  using  the  SGML  Reference  Data  from  the  CTN.  When  tool  was  run,  it  executed  properly. 
3  Summary 

This  tool  performs  its  intended  function. 

3  Uf  Analysis  of  VALIDG4 

3^1  Version 

VALIDG4  1.0 

SYSCON  Corporation  5/18/88 
3 .6^  Ease  of  Installation 

The  VALIDG4  tool  was  used  to  verify  the  CCITT  group  4  raster  image  data  file.  This  tool  was  loaded  on  our 
VAX  11-780  and  operated  under  VMS  53. 

3.63  Operating  System  Issues 

VALIDG4.C  is  written  m  C.  It  runs  fine  under  VMS  53. 

3.6.4  Ease  of  Use 

Because  there  was  no  user's  manual  for  VALID G4  tool,  we  looked  into  the  help  routine  in  the  source  code  to 
find  out  input  commands.  After  assigni^ig  the  ccsnukTnd  line  in  a  vahdg4.com  Ole,  we  were  able  to  run  the 
validg4.exe  program.  Accorduig  to  tlxi  a’Hjne  liBlp  menu,  we  set  the  input  command  qualiSers  as 
”$  vahdg4  ^ename.g4  -den  xxxx  -width  xxxxxx  -msb.” 

3.63  Execution 

For  the  test,  the  following  CTN  reference  test  data  files  were  used: 

PD  CTN  RAS  DWG  01  density  *  200,  width  *  1728 

PD  CTN  RAS  DWG  02  density  =  200,  width  =  2720 

PD  CTN  RAS  DWG  03  density  =  200,  width  *  2240 

These  raster  data  files  were  loaded  and  vaUdated  by  using  TAPEVAL  tools  before  the  test.  The  stripraster 
program  was  also  used  to  remove  the  header  files  and  the  data  files  DOOIROOXJIAS  were  renamed  as 
D00lR00X.g4. 

When  the  program  was  executed,  the  routine  attempted  to  validate  the  data  file,  D001R001.G4(PD  CTN  RAS 
DWG  01),  then  an  error  message  was  received  stating  "ERROR  GETCODE,  NO  MATCH  IN  12  BITS,  S  =  19, 
W=2B0."  Further  testing  was  conducted  usmg  different  raster  data  files  and  command  qualifiers,  we  still 
received  the  similar  error  messages,  ic.  "ERROR  GET  CODE,  NO  MATCH  IN  12  BITS,  S=  157,  W  ^  140. 
The  program  exited  at  this  point. 
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3  jS.6  Siunmaiy 


The  routme  did  not  validate  the  CTN  raster  test  data  Sles  even  though  they  appeared  to  be  correct.  Several 
combinations  of  input  command  qualifiers  were  entered  but  to  no  avalL  A  user's  guide  is  therefore  t£ce%ary.  We 
recommend  that  a  user's  guide  consisting  of  an  initial  set  up  of  the  command  file  for  the  VMS/VAX,  an  example 
to  e:mcute  the  program,  and  explanations  of  error  messages  be  provided  in  the  next  release  of  the  CTN  tools. 
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4.  Conclusions  and  Recommendations 

These  tools  represent  a  good  start.  We  have  used  them  extensively  and  will  continue  to  do  so. 

The  documentation  does  heed  improvement  In  some  cases  it  was  nonexistent  while  in  other  cases  it  was 
obsolete  or  erroneous.  Also  these  tools  should  be  more  portable.  In  particular,  it  would  be  nice  to  port  them  to 
the  Unix  and  DOS  environments  where  many  CALS  applications  are  running.  Also  these  tools  should  be  more 
integrated.  It  is  our  understanding  the  CTN  is  already  working  on  making  many  of  the  above  improvements.  We 
look  forward  to  using  the  next  revision  of  these  tools  as  soon  as  they  become  available. 
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